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Connectomic  reconstruction  of  the  inner 
plexiform  layer  in  the  mouse  retina 

Moritz  Helnistaedter^t>  Kevin  L.  Briggman^t,  Srinivas  C.  Turaga^j)  Viren  Jain^f)  H.  Sebastian  Seung^  &  Winfried  Denk^ 


Comprehensive  high- resolution  structural  maps  are  central  to  functional  exploration  and  understanding  in  biology.  For  the 
nervous  system,  in  which  high  resolution  and  large  spatial  extent  are  both  needed,  such  maps  are  scarce  as  they  challenge 
data  acquisition  and  analysis  capabilities.  Here  we  present  for  the  mouse  inner  plexiform  layer— the  main  computational 
neuropil  region  in  the  mammalian  retina— the  dense  reconstruction  of  950  neurons  and  their  mutual  contacts.  This 
was  achieved  by  applying  a  combination  of  crowd-sourced  manual  annotation  and  machine-leaming-based  voliune 
segmentation  to  serial  block-face  electron  microscopy  data.  We  characterize  a  new  type  of  retinal  bipolar  interneuron 
and  show  that  we  can  subdivide  a  known  type  based  on  connectivity.  Circuit  motifs  that  emerge  from  our  data  indicate  a 
functional  mechanism  for  a  known  cellular  response  in  a  ganglion  cell  that  detects  localized  motion,  and  predict  that 
another  ganglion  cell  is  motion  sensitive. 


Information  about  neuronal  wiring  has  long  been  the  basis  of  formu 
lating  and  testing  ideas  about  how  computation  is  performed  by  neural 
circuits.  Complete'"^  and  partial^  ^  wiring  diagrams  are  being  used  where 
available.  Whether  such  diagrams  can  be  created  by  statistical  extrapo 
lation  or  whether  higher  order  connectivity  is  functionally  important  is 
highly  controversial'’  The  assumption  that  mingling  neurites  connect 
(Peters’  rule'®)  allows  connectivity  to  be  inferred  from  light  microscopic 
observations  of  sparsely  stained  tissue,  but  is  frequendy  violated^’^,  show 
ing  that  connectivity  must  be  explicitly  tested  rather  than  inferred  from 
proximity.  Simultaneous  electrical  recordings  from  several  cells  can 
determine  and  quantify  their  synaptic  connectivity”  ”,  but  do  not  allow 
a  comprehensive  sampling  of  connections. 

Unlike  light  microscopy,  electron  microscopy  can  follow  even  the  thin 
nest  neurites  through  densely  stained  neuropil,  and  can  detect  unambi 
guously  whether  two  cells  touch  and  over  which  area'’”.  Serial  section 
transmission  electron  microscopy  was,  for  example,  used  to  reconstruct 
the  complete  wiring  diagram  of  the  roundworm  Caenorhabditis  elegans'^ 
and  to  study  synaptic  connectivity  in  the  retina'^  Volume  electron 
microscopy  data  sets  hundreds  of  micrometres  in  extent'®  have  been  used 
to  reconstruct  guided  by  previous  functional  imaging  specific  neural 
circuits®’'®. 

The  retina  performs  a  variety  of  image  processing  tasks  and  is  one 
of  the  best  studied  parts  of  the  central  nervous  system'®.  But,  only  in 
few  cases,  such  as  for  direction  sensitivity  (reviewed  in  ref  20),  has  the 
underlying  neural  computation  been  plausibly  explained,  combining 
information  from  anatomical  studies,  electrical  recordings  and  two 
photon  calcium  imaging®’'^’^"  ^®. 

Here  we  combined  serial  block  face  electron  microscopy  (SBEM)” 
data,  crowd  sourced  manual  annotation^®,  machine  learning  based 
boundary  detection^®’^^,  and  automatic  volume  segmentation  to  recon 
struct  the  neurites  of  950  neurons  in  a  114  pm  X  80  pm  area  of  the 
inner  plexiform  layer  (IPL)  and  aU  their  contacts  in  that  volume. 

We  establish  the  validity  of  the  reconstruction  using  known  circuits 
and  demonstrate  its  use  by  classifying  cells  based  on  their  electron 
microscopy  resolution  morphology,  by  isolating  a  new  type  of  bipolar 
cell,  by  showing  that  the  cell  to  type  contact  area  is  in  some  cases 


tightly  controlled  and  can  be  used  to  augment  type  classification,  and 
by  uncovering  several  cases  in  which  neurite  co  stratification  does  not 
predict  a  contact.  Among  the  functional  implications  of  these  findings 
is  the  prediction  that  a  particular  ganglion  ceU  is  motion  sensitive. 

Imaging  and  reconstruction 

We  used  SBEM  because  a  superior  z  resolution'®  and  lack  of  image 
distortions  makes  SBEM  data  sets  more  easily  traced  by  humans®  and 
segmented  by  computers.  The  main  data  set  used  in  this  study  (e2006) 
has  a  volume  of  more  than  1  million  pm^,  includes  all  layers  that  con 
tain  intra  retinal  synaptic  connections,  and  was  stained  to  enhance 
plasma  membrane  visibility®,  further  facilitating  traceability  and 
automated  segmentation. 

Because  completely  labelling  such  a  volume  by  hand  would  be 
prohibitively  expensive  (about  US$10  million),  we  tried  to  establish 
an  entirely  automatic  reconstruction  pipeline.  Our  SBEM  data  can  be 
automatically  segmented  into  objects  that  represent  the  local  cellular 
geometry  acurately^®’^^.  But  even  at  voxel  error  rates  of  a  few  per  cent, 
cells  get  fragmented  into  many  pieces  (M.H.  et  aZ.,  manuscript  in 
preparation).  Manually  traced  skeletons,  on  the  other  hand,  do  reli 
ably  establish  intra  cellular  continuity  over  large  distances^®  but  allow 
neither  identification  nor  quantification  of  cell  cell  contacts,  and 
visually  inspecting  close  skeleton  encounters®  is  impractical  for  the 
large  number  (roughly  10^)  expected  in  our  data  set.  Therefore,  we 
separately  created  skeletons  for  all  cells  by  crowd  sourced  manual 
annotation,  which  is  much  faster  than  manual  volume  tracing^®, 
and  volume  segmentation  (see  below). 

Skeletons  were  created  by  a  team  of  trained  human  annotators, 
which  included,  over  time,  more  than  224  different  students.  First,  the 
aimotators  identified  aU  somata  and  classified  them  as  photoreceptor 
(«>  2,000),  gUal  (w  1 73),  horizontal  («  33),  bipolar  (n  496),  ama 
crine  (n  407)  or  ganghon  {n  47)  cells,  based  on  soma  location  and 
emerging  neurites  (Fig.  la).  Starting  from  the  somata,  the  annotators 
skeletonized  the  neurites  of  aU  glial,  bipolar  (Fig.  lb),  amacrine  and 
ganglion  cells  using  the  KNOSSOS  program^®  (http://www.knossostool. 
org).  Multiple  tracings  by  different  annotators  (average  redundancies:  6, 


^Max-Planck  Institute  for  Medical  Research,  D-69120  Heidelberg,  Germany.  ^Department  ot  Brain  and  Cognitive  Sciences,  Howard  Hughes  Medical  Institute,  Massachusetts  Institute  of  Technology, 
Cambridge,  Massachusetts02139,  USA.  fPresent  addresses:  Max-Planck  Institute  of  Neurobiology,  D-82152  Martinsried,  Germany  (M.H.);  National  Institute  of  Neurological  Disorders  and  Stroke,  National 
Institutes  of  Health,  Bethesda,  Maryland  20892,  USA  (K.LB.);  Gatsby  Computational  Neuroscience  Unit,  London  WC IN  3AR,  UK  (S.C.T.);  Howard  Hughes  Medical  Institute,  Janeiia  Farm  Research  Campus, 
Ashburn,  Virginia  20147,  USA  (V.J.). 
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4  and  4  for  ganglion,  amacrine  and  bipolar  cells,  respectively),  were 
automatically  consolidated■^  visually  inspected  and,  in  a  few  cases, 
manually  corrected.  A  total  of  >20,000  annotator  hours  yielded  2.6  m 
of  skeletons,  representing  0.64  m  of  neurite,  with  estimated^  error  rates 
of  9, 12  and  6  per  ganglion,  amacrine  and  bipolar  cell,  respectively. 

Cell  types 

We  classified  all  neurons  into  cell  types  by  visual  inspection  of  the  bare 
skdetons,  with  a  focus  on  the  IPL  We  found  n  459  almost  complete 
bipolar  cells  (Fig.  Ic;  all  reconstructed  types  and  cells  are  shown  in 
Supplementary  Data  1  and  6,  respectively).  Most  bipolar  cells  clearly 
belonged  to  one  of  the  10  types  described  previously^  (Fig.  Ic). 
However,  particularly  for  OFF  cone  bipolar  cells  (CBCs)  ( 1  4),  some 
classification  ambiguity  remained,  even  after  taking  into  account 
tiling.  A  random  re  examination  of  59  ON  CBCs  (CBC5  9)  found 
one  error. 

Seven  cells  showed  no  similarity  to  any  of  the  ten  bipolar  types“,  but 
shared  a  distinct  morphology  and  were  designated  as  XBCs  (Fig.  Id 
and  Supplementary  Data  2a).  XBC  axons  stratify  more  narrowly  but  at 
the  same  average  depth  as  CBCS  (Fig.  Id,  e).  Laterally,  XBC  axons 
roam  widely,  similar  to  CBC9,  but  their  dendrites  are  comparativdy 
compact  different  from  CBC9  (Supplementary  data  2b),  and  their 
depth  suggests  that  they  contact  cones. 

The  dendrites  of  all  ganglion  cells  and  of  many  amacrine  cells 
extended  beyond  the  data  set  volume.  Many  ganglion  and  amacrine 
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Figure  1  |  Raw  data,  skdetons  and  bipolar  cell  analysis,  a,  Somata,  from  the 
left:  photoreceptor  (grey),  horizontal  (green),  bipolar  (red),  gHa  (yellow), 
amacrine  (blue)  and  gar^Iion  (grey)  cells.  Also  shown  (white)  are  axons  for  two 
CBCl,  one  CBC6  and  two  CBC7  cells.  GCL,  ganglion  cell  layer;  INL  inner 
nuclear  layer,  OPL,  outer  plexiform  layer;  PRL,  photoreceptor  layer,  b.  Side 
views  fi'om  two  orthogonal  directions  onto  a  single  CBC4  skeleton  (top),  and 
light  axis  (l4i.)  views  of  dendrite  (left)  and  axon  (bottom),  c.  One  example  for 
each  bipolar  cell  type,  d.  All  XBC  skeletons,  side  view,  e.  Skeleton  density 
(segmentlength/vote  count,  normalized  across  IPL)  versus  depth  for  all  bipolar 
cell  types  (oneprofile  shown  forthe  entire  CBCS  population).  Inset:  bipolar  cell 
prevalence  (colours  as  for  depth  profiles).  Scale  bars,  10  pm. 


cells  could  nevertheless  be  grouped  by  inspecting  their  neurites  (12 
gan^ion  cell  types.  Fig.  2a,  b;  12  narrow  field  amacrine  cell  types. 
Fig.  2c,  d;  33  medium/wide  field  amacrine  cell  types,  including  6 
displaced  types.  Fig.  2e,  f  and  Supplementary  Data  1  and.  6).  We  used 
the  type  averaged  (for  individual  variations  see  Suppleme  ntary  Data  1 ) 
neurite  density  over  depth  in  the  IPL  (Fig.  2)  to  create  for  all  amacrine 
and  ganglion  cell  types  unique  identifiers  (ac64  73,  for  example,  is  an 
amacrine  cdl  type  with  first  and  third  quartiles  at  64%  iind  73%  IPL 
depth,  re^ectively).  Prominent  among  cell  types  previously  known 
(see  Supplementary  Data  7  for  a  complete  listing)  are  gc:30  63,  ac25 
31  and  ac60  65,  corresponding  to  ON/OFF  direction  selective  gan 
gjion  cdls*’  (DSGCs;  Fig.  2a)  and  ON  and  OFF  starburst  amacrine 
cells'*  (SACs;  Fig.  2e),  respectivdy. 

Contact  detection 

We  next  combined  the  skeletons  with  an  automatic  segmentation 
(Fig.  3),  created  by  first  training  a  convolutional  network  to  detect  cdl 
boundaries'^  followed  by  several  growth  and  merge  steps  (Fig.  3  a).  The 
final  volume  consolidation  into  a  representation  of  the  cellular  geo 
metry  was  performed  by  combining  for  each  cdl  all  segments  overlap 
ping  its  skeleton  (Fig.  3b,  typically  several  hundred  sejpnents;  total 
estimated  volume  error  rate  about  3%,  see  Methods). 

Of  1,123  fully  volume  reconstructed  ceUs,  173  were  glia,  110  were 
orphans  (one  of  a  kind  cells  or  cells  without  a  reasonable  neurite 
morphology),  and  840  were  the  neurons  used  in  the  analysis.  All  con 
tacts  (n  579,724)  between  them  were  automatically  detected  and 
quantified  ( Fig.  3c,  Supplementary  Data  5  and  Methods).  When  testing 


Figure  2  |  Ganglion  and  amacrine  ceUs.  a,  Normalized  ganglion  cell  depth 
profiles  fbr  gc31  56,  gc36  51  (W3),  gc30  63  (DSGQ  and  the  remaining  cell 
types  (grey),  b.  All  three  gc3 1  56  cells  (somata:  grey  disks,  side  (top)  and  light 
axis  (bottom)  views),  and  all  other  inner  nudear  layer  and  gan{;lion  cell  layer 
(somata:  black  dots,  side  view  only),  c.  Narrow  field  amacrine  cell  depth 
profiles  fbr  ac21  67,  ac52  90  (A2)  and  remaining  narrow  field  lamacrine  cells 
(grey),  d,  One  example  each  for  ac21  67  and  ac52  90  (A2).  e.  Medium  field 
amacrine  depth  profiles  for  acl9  30,  ac25  31  (OFF  SAC),  ac35  41,  ac60  65 
(ON  SAC),  ac34  84  (A  17)  and  remaining  medium  field  amacrine  cells  (grey), 
f.  Light  axis  view  for  acl9  30.  Scale  bars,  10  pm. 
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Figure  3  |  Automatic  segmentation  and  contact 
detection,  a.  From  left:  raw  data  (offset  and 
contrast  adjusted),  edge  classifier  (xy,:  average), 
initial  and  iterated  segmentations  (sei;  also 
Supplementary  Data  3e  g).  b.  From  lop:  bare 
skeleton,  skeleton  with  overlapping  s<;gmentation 
objects,  and  the  resulting  volume  rep;resentation 
for  a  CBC6  axon,  c.  Automatically  det  ected  contact 
(red  arrow)  between  a  CBC5  cell  and  a  DSGC 
(gc30  63).  d.  Cross  sections  through  a  non 
synaptic  contact  (left,  Supplanentary  Data,  3a,  b) 
and  a  ribbon  synapse  (right)  from  data  set  k563, 
coloured  by  hand,  e.  Frequencies  (bottom)  of  non 
synaptic  (red,  n  =  63)  and  synaptic  (green,  n  =  30) 
cell  cell  contacts  veisus  contact  area  and  the 
Gaussian  fits  to  them  (thin  lines,  cenire/width: 
0.18/0.38  and  0.22/1.13,  all  in  pm^)  and  the 
resulting  synapse  probability  (syn.  prob.)  estimate 
(top).  Scale  bau-s,  1  pm  (a),  500  nm  (d). 


the  reliability  of  the  algorithm,  we  found  that  it  missed  none  of  16 
contacts  visually  identified  in  the  raw  data,  and  20  randomly  selected 
algorithm  generated  contacts  contained  only  one  false  contact  (caused 
by  debris  in  one  image). 

The  cell  to  cell  contact  area  matrix  (Fig.  4a  and  Supplementary 
Data  4)  includes  only  contacts  that  are  individually  below  5  pm^ 
(about  99.9%  of  all  contacts),  thus  excluding  touching  somata  and 
neurite  bundles,  and  was  then  condensed  into  a  type  to  type  matrix 
(Fig.  4b  and  Supplementary  Data  4).  When  exploring  the  circuit  that 
couples  rod  photoreceptor  signals  into  the  cone  pathway^®,  we  found 
the  A2  amacrine  cell  (ac52  90)  contacting  the  rod  bipolar  cell  (RBC) 
very  strongly  (with  23.6%  of  the  A2  cell  total  detected  neuronal  con 
tact  area),  contacting  OFF  CBCs  quite  well  (6.4%,  43%,  1.8%,  3.2% 
and  2.9%,  for  types  1,  2,  3A,  3B  and  4,  respectivdy),  and  contacting 
ON  CBCs  more  weakly  (mostly  CBC6  (2.0%)  and  CBC7  (1.4%),  but 
not  the  XBC  (0.2%)).  The  RBC,  38.3%  of  whose  contact  area  is  with 
the  A2  cell,  also  strongly  contacts  (with  13.5%)  ac34  84  (also  known 
as  an  A17  amacrine  cell)^'. 

Even  when  two  cdl  types  stron^y  contact  each  other  (Fig.  4b),  the 
contact  area  between  each  individual  pair  of  cells,  one  from  each  type, 
varies  widely  (Fig.  4a).  To  test  whether  individual  cells  still  form 
reliable  channels  of  information,  we  compared  how  the  total  contact 
area  that  a  cdl  of  tyqre  A  makes  with  all  cells  of  type  B  varies  among  the 
cells  of  type  A.  For  example,  the  contact  areas  between  individual  ON 
SACs  and  aU  cells  of  the  CBC5R  ‘type’  (9.9%  on  average,  the  most 
strongly  contacted  one  among  the  CBCs)  vary  by  only  about  16% 
(s.cL/mean;  Fig.  4c).  At  the  same  time,  the  contact  area  between  A2 
amacrine  cells  (ac52  90)  and  all  RBCs,  which  is  on  average  even 
stronger  (24%),  fluctuates  more  widely,  by  25%  (s.d./mean). 

To  test  how  much  information  about  the  actual  synaptic  connect! 
vity  is  provided  by  our  contact  area  measurements,  we  used  the  size 
distributions  for  synaptic  and  incidental  contacts,  measured  in  a  data 
set  (k563,  ref  5)  with  prominently  stained  synaptic  vesides  and  thick 
enings  (Fig.  3d,  e  and  Supplementary  Data  3a,  b),  to  estimate,  for  all 
C  BC  ganglion  cell  pairs,  how  many  true  synaptic  contacts  to  expect  for 
a  given  total  contact  area  between  two  cells  (Fig.  4d),  and  found  that  for 
a  total  contact  area  as  small  as  0.08  pm^,  at  least  one  synaptic  contact 
exists  with  a  probability  of  50%,  increasing  to  95%  for  an  area  of  1  pm^. 

Connectivity-based  type  classification 

We  next  explored  whether  comprehensive  contact  information  con 

tained  in  the  cell  to  cdl  matrix  can  be  used  to  discriminate  between 


otherwise  very  similar  cell  types.  When  we  searched  for  a  way  to 
divide  the  CBC5s,  which  fall  into  two  molecularly  distinguishable 
dasses  in  rats^  and  are  too  numerous  for  a  single  class  in  mouse™, 
by  using  their  connectivities  to  ganglion  cdls  and  amacrine  cells, 
gc31  56  and  gc36  51  emerged  as  potential  discriminatois  (Fig.  5a). 
A  reasonably  complete  tilingpattern  resulted  (Fig.  5b)  when  including 
only  cells  (n  22)  contacting  gc31  56  more  stron^y  thian  gc36  51 
(the  exception  was  a  single  cell,  which  was  near  that  threshold  but  was 
not  induded  to  avoid  strong  axonal  overlap;  asterisk  in  Fig.  5a).  This 
group  of  cells,  ‘CBC5A’,  also  shows  a  strong  repulsion  be  tween  their 
dendritic  centroids  (Fig.  5c),  indicating  a  mosaic  and  hence  a  pure 
type^^  and  is  spedfically  avoided  by  ac43  49  (Fig.  5a).  The  remaining 
37  cells  (‘CBC5R’)  still  show  strong  axonal  overlap,  lack  a  mosaic 
(Fig.  5b,  c),  and  are  thus  probably  a  mixture  of  types  for  which  we 
did  not,  however,  find  a  connectivity  based  discriminator.  The  depth 
profiles  of  CBC5A  (first  and  third  quartiles:  54%  and  61%)  and 
CBC5R  (50%  and  59%;  Fig.  5d)  seem  to  be  different.  Tern  cells  did 
not  overlap  the  dendrites  of  both  gan^ion  cell  types  ( Fig.  5b)  and  were 
therefore  collected  into  a  separate  group  (‘CBC5X’). 

XBC  circuits 

We  next  investigated  how  the  XBC  is  integrated  into  the  IPL  circuitry 
(Fig.  6a  c).  Like  RBC  and  CBC7,  XBC  devotes  less  of  its  contact  area 
to  ganglion  cells  than  the  average  bipolar  cell  (Fig.  6a).  XIJC  strongly 
contacts  (Supplementary  Data  2b)  medium/wide  field  amacrine  cells 
ac38  56  (15.5%)  and  ac53  59  (7.1%),  of  which  ac53  59  shares  the 
XBC  sharp  depth  profile  (Fig.  6b)  and,  in  turn,  makes  aintact  with 
gc31  56  (3.5%)  and  gc47  57  (4.2%).  Those  ganglion  cellis,  however, 
receive  only  minimal  amounts  (0.9%  and  0.4%)  of  their  contacts 
directly  from  the  XBC,  even  though  their  dendrites  strongly  overlap 
XBC  axons  in  depth  (Fig.  6b).  Instead  gc31  56  receives  direct  bipxrlar 
cell  contacts  mainly  from  CBC5A  (7.0%)  and  gc47  57  from  CBC5R 
(12.0%).  ac38  56  is  bistratified,  overlapiping  in  the  ON  stratum  writh 
the  XBC  and  in  the  OFF  stratum  with  gc35  41  (Fig.  6b,  c),  which  is 
dearly  an  OFF  cdl  (contacting  CBCs  3A,  3B  and  4,  with  5.4%,  6.3% 
and  5.4%,  respectively;  all  other  CBCs  are  at  most  0.5%)  and  receives 
10.0%  of  its  contacts  from  ac38  56. 

ON/ OFF  ganglion  cell  circuits 

Some  of  the  best  studied  gan^ion  cells  respond  to  both  ON  and  OFF 
stimuli.  We  therefore  analysed  the  connection  ptattems  onto  several 
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Figure  4  |  Contact  matrices,  a,  Cell  cell  contact  size  matrix  (see  also 
Supplementary  Data  4  and  5).  Classes:  ganglion  cells  (GCs),  amacrine  cells 
(ACs),  bipolar  cells  (BPCs),  from  left  to  right  Ordoir^  within  classes:  gar^lion 
cells,  types  by  depth  (average  of  first  and  third  quartile)  in  the  IPL.  Amacrine 
cells:  narrow  field  (nf),  medium/wide  field  (mf/wO  (including  displaced). 
Within  sub  classes:  by  depth,  except  bipolar  cells  (by  numbering  in  ref.  28,  XBC 
after  5X  and  RBC  last).  Within  types:  random  order.  Dark  lines  along  top  and 
right  side:  every  other  type  Inset  (bottom  left):  contact  area  to  grey  value  (grey 
vaL)  mapping  and  prevalence  (prev.).  b.  Type  type  matrix,  normalized  along 
rows;  alongleft  edge:  cells/ type  (note  log  scale);  along  bottom  edge:  median  and 
depth  range  (between  quartiles)  for  each  type  c.  Total  contact  area  between 
each  ON  SAC  (ac60  65.  cell  numbers  along  the  x  axis)  and,  respectively,  all 
CBCs  and  RBCs,  normalized  to  the  total  contact  area  of  each  SAC.  d,  The 
number  of  true  synaptic  contacts  expected  (Stochastic  simulation,  1,000  runs 
per  cell  pair)  for  each  actual  CBC  to  ganglion  cell  pair  using  the  fits  in  Fig  3e 
versus  the  total  cell  cell  contact  area  (median:  green  line,  lower  and  upper  95% 
confidence  levels,  red  lines). 


ganglion  cells  that  ramify  in  both  ON  and  OFF  layers  (Fig.  6d  f)- 
Among  those,  gc36  51  (‘W3a’)  and  gc44  52  (‘W3b’)  are  consistent 
with  cdls  labelled  in  the  TYW3  mouse^.  Either  or  both  are  likely  to  be 


Figure  5  |  CBCS  subtypes,  a,  CBC5s  ordered  by  decreasing  preference  for 
gc31  56overgc36  51  (blacktrace:contactarea  withallgc31  56s/ sum  of  contact 
areas  to  gc31  56  and  gc36  51).  Also  shown  is  the  contact  area  svith  ac43  49 
(A«:«  «•  green  trace,  relative  to  max).  Dashed  line  denotes  border  between 
CBC5A  and  CBC5R.  Asterisk  denotes  CBCS  cell  switched  to  CBC5R  to  avoid 
mosaic  violation,  b,  Dght  axis  views  of  CBCS  A  (5  A;  top)  and  CBC5R  (5X 
bottom)  axons.  Red  outline:  region  containing  dendrites  from  l)Oth  gc36  51 
and  gc3 1  56;  thin  dashed  hne:  data  set  border.  Scale  bars,  1 0  pm.  c,  V ariation  of 
dendritic  centroid  nearest  neighbour  distances  (NNdist)  (standard  deviation/ 
median)  fitr:  all  CBCSs,  only  5A,  only  5R,  the  mixture  of  6  and  7,  only  6,  only  7, 
and  a  set  of  1,000  simulations  randomly  placing  22  points  (error  bar  denotes 
fifth  to  ninety  fifth  percentile),  d,  Normalized  skeleton  density  depth  profiles. 

homologous  to  what  is  called  the  ‘local  edge  detector  in  rabbit^*"^* 
(Fig.  6d).  Their  contact  patterns  with  CBCs  are  mostly  similar 
(gc36  51/gc44  52:  CBC5R,  7.5%/11.5%;  CBC5A,  1.3%/i0.8%;  CBC4, 
3.0%/3.9%;  CBC3A,  1.7%/1.8%;  and  CB3B.  3.2%/1.7%;  Supplemen 
tary  Data  1),  with  the  exception  of  the  outermost  part  of  the  inner 
nuclear  layer  (INL)  (CBC2,  1.5%/0.1%,  and  CBCl,  1.6%/0.1%). 
Substantial  contacts  are  made  by  gc36  51  and  gc44  52  wdth  several 
narrow  field  amacrine  cells,  ac52  90  (6.0%/2.8%  (ref.  37),  A2),  ac21 
67  (3.8%/2.1%).  ac51  70  (3.5%/5.0%)  and  ac21  44  (3.3%/2.2%).  The 
strongest  amacrine  cell  contact  made  by  gc36  51  is  with  ac43  49 
(6.8%),  which  straddles  the  boundary  between  ON  anti  OFF  layers 
(Supplementary  Data  1),  and  also  substantially  contacts  gc44  52 
(5.6%)  as  well  as  ON  and  OFF  bipolar  cells  (CBC5R,  9.3%,  and 
CBC4, 5.0%).  ac43  49  is  one  of  two  medium/wide  field  ai.Tiacrine  cdls 
that  dedicate  most  of  their  contacts  to  gc36  51  and  gc:44  52  (Stqi 
plementary  Data  1).  The  second  is  ac44  54  (7.0%/6.2%),  a  cdl  domi 
nated  by  ON  CBCs  (7.9%  with  CBC5R  compared  to  1.3%,  2.0%  and 
1.2%,  with  CBCs  3A,  3B  and  4,  respectively). 

The  ON/OFF  DSGC  (gc30  63,  Fig.  6f),  as  expect ed.^’^‘,  stron^y 
contaas  SACs  (9.2%  and  11.4%,  for  ac25  31  (OFF  SA(3)  and  ac60 
65  (ON  SAC)),  but  substantial  contacts  from  other  medhim/wide 
field  amacrine  cells  are  conspicuously  absent  (ac34  84,  2.5%,  all 
others  <  1.6%).  Like  gc36  51/gc44  52  (W3a/b),  the  DSGC  prefers 
CBC5R  (6.9%)  to  CBC5A  (1.9%,  all  other  ON  CBCs  at  most  1.1%). 
Its  main  OFF  ‘input’  comes  frwn  CBC4  (3.2%)  and  CBC/l  (A/B,  3.0%/ 
2.7%).  SACs  make  most  contacts  (Fig.  6e)  among  themsdves  (26.6% 
and  21.4%  for  ON  and  OFF).  They  discriminate  less  tham  the  DSGC 
between  CBC5R  (9.7%)  andCBC5A  (5.0%),  but,  most  not  ably,  contact 
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Figure  6  |  Circuits  originating  front  the  XBC  and  ON/OFF  cells,  a  f,  IPL 
circuitry  from  the  XBC  (a  c)  and  from  three  ON/OFF  cells  (d  f)-  Fractional 
contact  areas  between  all  gan^on  cells  and  each  bipolar  cell  b,  Depth  profiles, 
c,  XBC  circuit  schematic,  d,  One  gc36  51/W3a  (cell  16),  oneac43  49 
(cell  307),  one  CBC5R  (cell  578)  and  all  the  detected  contacts  between 
(cyan  spheres,  volume  proportional  to  contact  area),  e.  Normalized  contact 
areas  for  amacrine  cells  and  bipolar  cells  with  both  SACs  (ac25  31,  blue; 
ac60  65,  red),  f.  Circuit  diagrams.  Arrow  width  in  circuit  diagrams 
proportional  to  (total  contact  area  between  types)®'®.  Only  connections  with 
areas  per  type  >30  pm^  shown. 


CBC7  (5.1%),  which  is  largely  ignored  by  the  DSGC  (1.1%,  Fig.  6f). 
Similar  differences  are  seen  for  the  OFF  sublamina:  DSGiZ  and  SAC 
contact  strengths  to  CBC1/CBC2  are  1.4%/0  5%  and  4.7%/3.1%, 
respectively. 

Our  last  example  is  the  analysis  of  a  cell  not  associated  with  any 
known  type  in  mouse  but  possibly  homologous  to  a  rabbit  retina®* 
ON/OFF  gan^ion  cell.  gc31  56  is  an  ON/OFF  cdl  by  stratification 
(Fig.  2a,  b),  filling  the  space  between  the  SAC  bands  (Fig.  2a,  e),  and 
‘connects’  strongly  to  both  SACs  (ac60  65,  5.4%,  and  ac25  31, 7.1%). 
Surprising  is  the  strong  imbalance  between  ON  and  OFF  bipolar  cell 
‘input’  (7.0%/3.7%  for  CBC5A/R,  but  only  0.8%,  0.7%,  0.9%,  1.5%  and 
1.2%,  for  CBCl,  2,  3A,  3B  and  4). 

Discussion 

Our  comprehensive  analysis  of  the  bipolar  cells  confirmed  the  exist 
ence  of  the  ten  bipolar  cell  types  previously  identified®*,  and  revealed 
the  existence  of  the  XBC,  whidi  had  not  emerged  even  in  large  genetic 
screens'*.  Although  sharp  stratification  and  large  size  (Fij;.  Id,  e  and 
Supplementary  Data  2a,  also  note  the  similarity  to  cluster  6  in  ref  40) 
surest  homology  between  the  XBC  and  the  giant  bipolar  cell  des 
cribed  recently  in  the  primate  retina*',  the  small  size  of  the  XBC 
dendrites  relative  to  its  axonal  arbour  argues  against  it  The  fimctional 
role  of  the  XBC  is  undear.  Its  sparseness  su^ests  low  spatial  resolu 
tion  and  its  small  dendritic  fidds  surest  that  it  does  not  collect  signals 
from  all  cells  of  one  cone  type,  thus  potentially  forgoing  some  amount 
of  signal.  Curious  is  the  absence  of  a  bipolar  cell  with  a  similarly  sharp 
stratification  on  the  OFF  side.  Instead,  we  find  an  inter  layer  connec 
tion  via  the  symmetrically  bistratified  ac38  56  (Fig  6b,  c).  One  might 
speculate  that  the  XBC  is  part  of  a  luminance  adaptation  pathway. 

Dense  sampling  and  the  complete  high  resolution  reconstruction 
of  neurites,  as  is  only  possible  with  three  dimensional  electron  micro 
scopy  data,  contributes  in  several  ways  to  cell  type  dassification.  First, 
when  all  cells  of  a  class,  for  example,  all  bipolar  cells,  are  recon 
structed,  no  type  will  be  missed  and  the  prevalence  of  different  types 
can  be  determined  predsely  (Fig.  le,  inset).  Second,  differences  in 
neurite  geometry  can  be  compared  for  cells  within  the  same  piece 
of  tissue.  For  almost  all  bipolar  cells  and  a  substantial  fraction  of 
ganglion  and  amacrine  cdls,  it  was  thus  possible  to  establish  a  cor 
respondence  to  cell  types  described  in  the  litCTature  (Sup)plementary 
Data  7).  We  generally  erred  on  the  side  of  splitting  groups  and  expect 
that  some  groups  actually  bdong  to  the  same  type  (for  example,  the 
similar  connectivity  to  the  XBC  suggests  that  ac38  56  and  ac37  52 
could  be  the  same  type;  Supplementary  Data.  4).  Third,  e:ven  if  they 
cannot  be  selectively  stained  and  imaged,  tiling  and  mosaic  formation 
(both  used  to  assess  purity  of  type®®)  can  be  easily  assessied  (Figs  2b 
and  5b  and  Supplementary  Data  1). Fourth,  completecontact  informa 
tion  can  confirm  or  refine  the  definition  of  types  (Fig  5),  and  may 
ultimatdy  become  sufficient  for  classification  all  by  itsdf*®. 

Because  of  the  constrained  size  of  our  data  set,  many  amacrine  cell 
and  all  ganglion  cell  neurites  are  truncated,  and  many  larger  neuron 
types  are  presumably  completely  missed®*'*®.  Advances  in  volume 
electron  microscopy  technology'*  now  make  it  possible  to  acquire 
volumes  with  a  lateral  extent  of  at  least  500  pm.  One  mig^it  then,  using 
the  same  tools  emd  a  similar  manual  annotation  effort  as  W'ere  used  in 
our  study,  densdy  reconstruct  a  central  region  of  100  prn  in  extent 
and  trace  neurites  of  passage  far  enough  into  the  peripheiry  to  deter 
mine  their  cell  type. 

Although  our  analysis  provides  contact  areas  and  not  synaptic 
strength,  the  absence  of  contact  always  indicates  a  lack  of  synaptic 
connection.  The  abseice  of  contacts  between  some  cell  types,  for 
example,  XBC  and  gc35  41  as  well  as  CBC7  and  DSGC,  the  neurites 
of  which  mingle  extensively,  confirms  that  Peters’  rule'®  is  routindy 
violated.  Furthermore,  it  seems  that  large  contacts  are  quite  likely  to 
be  synaptic  (at  least  between  bipolar  cdls  and  gan^ion  cells;  Rgs  3e 
and  4d).  Although  we  have  not  used  them  here,  other  geometric 
parameters  describing  contact  shape  might  provide  enoug^i  additional 
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information  to  identify  actual  contacts  with  near  certainty  for  many 
types  of  synapses. 

It  has  been  our  consistent  experience  that  selectivdy  enhancing 
cell  surface  contrast^  simplifies  manual  tracing  and  enables  automatic 
volume  segmentation.  If  recent  results  that  suggest  that  even  conven 
tionally  stained  tissue  can  be  reliably  traced  by  hand  (K.L.B.  and  M.H., 
unpublished  observations)  and  automatically  segmented^'*  (M.  Berning 
and  MH.,  personal  communication)  are  confirmed  it  may  no  longer  be 
necessary  to  trade  traceability  for  synajjse  identification. 

The  rdiability  of  the  entries  in  the  contact  matrix  depends  on 
several  factors.  Likdy  dominant  are  neurite  continuity  errors,  which 
occur  roughly  six  times  per  bipolar  cdl“  but  presumably  mostly  in  the 
periphery  and  thus  should  cause  only  a  small  fractional  loss  (or  false 
addition)  of  synapses.  Local  volume  reconstruction  seems  to  be  fairly 
reliable.  Finally,  although  not  all  contacts  are  synaptic,  there  are,  typ 
ically,  many  contacts  between  any  actually  connected  pair  of  cells'*^'**, 
making  it  unlikely  that  any  strong  connection  is  spurious.  The  con 
nectivity  estimate  between  CBC5R  (38  cells)  and  W3a  (gc36  51,  3 
cells),  for  example,  is  based  on  the  areas  of  1358  observed  contacts, 
for  which  our  simulation  predicts  between  278  and  705  synaptic  con 
tacts  (fifth  and  ninety  fifth  percentiles,  respectivdy)  tvith  a  median  of 
483  contacts,  that  is,  13  per  bipolar  cdl  and  161  per  ganglion  cell.  The 
direction  of  a  potential  synaptic  connection  can  in  most  cases  not  be 
determined  by  visually  inspecting  the  e2006  data  set  but  contacts  onto  a 
ganglion  cell,  for  example,  are  presumably  never  postsynaptic. 

Our  analysis  of  three  ON/OFF  layer  cell  types  has  several  concrete 
functional  implications,  which,  at  the  very  least,  will  guide  further 
exploration  by  other  means.  For  example,  ‘bri^f  W3  cells  (gc36  51 
or  gc44  52)  respond  much  more  vigorously  to  a  small  darkening  spot 
than  to  a  small  brightening  spot  (Fig.  5b  in  ref.  47).  This  may  well  be 
due  to  the  ac44  54  mediated  feed  forward  inhibitory  pathway  on  the 
ON  side  (Fig.  6f  and  Supplementary  Data  1),  for  which  no  corres 
ponding  pathways  is  seen  on  the  OFF  side.  W3b  CBC  contacts  are 
concentrated  on  the  ON  side  (ON/OFF;  15.2%/7.6%)  but  evenly 
balanced  for  W3a  (10.9%/10.9%),  which  su^ests  that  it  is  W3a 
(gc36  51)  that  corresponds  to  the  physiologically  examined  cells 
described  previously'‘L  Anoftiff  characteristic  of  the  W3  cdl  is  that 
its  response  is  completdy  suppressed  by  movement  in  the  receptive 
fidd  surround*".  Given  the  lackof  thin,  unbranched  processes  emerging 
fit)m  its  soma,  it  is  unlikdy  that  ac43  49  corresponds  to  the  poly  axonal 
amacrine  cell  implicated  in  this  suppression*",  but  ac43  49  may  wdl 
mediate  (or  at  least  augment)  suppression  for  stimuli  in  the  near 
surround  (M.  Meister,  personal  communication).  It  could  do  this  for 
OFF  and  for  ON  stimuli  because  it  is  contacted  by  CBCs  in  both  OFF 
and  ON  layers  (Fig.  6f  and  Supplementary  Data  1). 

In  addition  to  DSGCs  (gc30  63),  SACs  contact  gc31  56  stron^y 
(Fig.  6f).  It  will  be  interesting  to  find  out  whether  gc31  56  is  also 
direction  sensitive,  or  at  least  motion  sensitive,  and  why  there  is  a 
morphological  symmetry  (Fig.  2b)  between  the  ON  and  OFF  layers  in 
gc31  56  but  a  strong  imbalance  between  the  strong  ON  bipolar  cell 
and  the  weak  OFF  bipolar  cell  ‘input’  (Fig.  6f). 

The  circuit  motifa  found  for  W3a/b,  XBC  and  gc31  56  are  only  the 
first  of  many  examples  of  motifs  likely  to  be  found  when  these  data  (a 
repository  of  raw  data,  skdetons  and  volume  s^mentation  can  be 
found  at  http://www.neuro.mpg.de/connectomics)  are  examined  in 
the  context  of  virtually  every  functional  question  in  the  retina. 

METHODS  SUMMARY 

Tissue  preparation  for  SBHM.  The  retinae  for  the  e2006and  k563  data  sets  were 
prepared  as  described  previously^. 

SBEM  imaging  and  data  analysis.  The  sample  was  mounted  in  a  custom  built 
ultra  microtome  operating  inside  the  chamber  of  a  fidd  emission  scanning  dec 
Iron  microscope  (FEl  QuantaFEG  200),  and  serial  block  &ce  inured  under 
130  Pa  hydrogen,  at  3  keV  landing  energy,  a  dose  of  14  dectrons  per  nm^,  and 
a  resolution  of  165  X  16.5  X  25  nm^  (for  the  conventionally  stained  sample,  see 
Methods).  A  custom  designed  back  scattered  electron  detector  was  used.  SBEM 
data  were  aligtted  and  stitched  using  custom  Matlab  routines.  Skeletons  were 


manually  traced  by  trained  student  annotators  using  cirstom  written  software 
(KNOSSOS,  http://wwwJcnossostooI.org)  and  consolidated  using  RESCOP*'. 
Volumes  were  traced  using  KLEE  (MJL  etd.,  manuscript  in  prepara  6on).  Boundary 
classification  was  with  a  five  hidden  layer  convolutional  neural  network  that  was 
trained  usir^  the  MAUS  procedure*’  (S.CT.  et  nL  manuscript  in  preparation). 
Segmentation  used  a  15  step  iterative  growth  procedure,  foOowed  by  a  6  step 
merging  prrxedirre.  Data  visualization  was  in  KLEE,  Knossos,  N4atlab,  Mathe 
matica  and  Amira. 

Full  Methods  and  any  associated  references  are  available  In  the  online  version  of 
the  paper. 
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METHODS 

DaUacqiii.silion.  A  rctinafroma  30  day  old  C57BL/6maiise(datasete2006)  was 
prepared  to  selectively  enhance  cell  outlines  by  using  the  horseradish  peroxidase 
(HRP)  mediated  precipitation  of  33'  diaminobenzidine  (DAB),  as  described 
previoudy^,  and  stained  with  osmium  and  lead  citrate.  The  shrinkage  of  our  tissue 
was  very  likely  the  same  as  that  for  the  e2 198  sample^  which  was  imaged  in  the 
Ih'ing  state  by  two  photon  microscopy  and  then  by  SBEM,  allowing  a  precise 
estimate  (14%)  of  the  linear  shrinkage  factor  (K.  LB.  etaf,  unpublished  o^rva 
tions).  All  procedures  were  approved  by  the  local  animal  care  committee  and  were 
in  accordance  with  the  law  of  animal  experimentation  issued  by  the  German 
Federal  Government 

Ihe  embedded  tissue  was  trimmed  to  a  block  6ice  of  ~200)imX  300pm  and 
imaged  n  a  scanning  electron  microscope  with  a  field  emission  cathode  (QuantaFBG 
200,  F£I  Company)  and  a  custom  designed  back  scattered  dectron  detector  based  on 
a  silicon  diode  (AXUV,  International  Radiation  Detectors)  combined  with  a  custom 
built  cirrent  ampbner  ().  Tritthardt  Max  Planck  Institute  for  Medcal  Research, 
dectronics  shop).  'Die  iiKident  dectron  energy  was  3.0  keV,  the  beam  current 
~100pA.  At  a  pixd  dwdi  time  of  6ps  and  a  pixd  size  of  16.5  run  X  16.5  tun  this 
resulted  in  an  electron  dose  of  about  14  dectrons  nm  \  not  accounting  for  skirting 
due  to  low  vacuum  operatioa  ’Hie  chamber  was  kept  at  a  pressure  of  1 30  Pa  hydro 
gen  to  prevent  charging.  The  electron  microscope  was  equ^pedwidi  a  custom  made 
microtome'*,  which  allows  the  repeated  removal  of  the  block  surfoce  at  a  cutting 
thickness  of  2:25  nm.  A  total  of  33(X)  consecutive  slices  were  im^ed,  leading  to  a  data 
volume  of  8,192X  7fl72X  3300voxels  (a  4X  4  nwsaic  of  images  2,048X  1,768 
pixels  in  size).  As  the  edges  of  neighbourir^  mosaic  ima^s  owdapped  by  ~  1  pm, 
this  corresponds  to  a  physical  size  of  about  1 32  pm  X  1 14  pm  for  each  slice  and  a 
total  thickness  of  80  pm.  Note  that  stitching  led  to  substantial  shear  (about  4 
degrees)  in  z. 

The  cuttir^  speed  was  0.5  mm  s  ‘.To  avoid  chatter  and  ensure  even  cutting,  the 
diatixmd  knife  (facet  angle  50  ,  dearance  angle  20 \  Diatome)  was  vibrated  along  the 
knife  edge  direction  with  a  fre(|uency  of  ~  12  kHz  usir^  a  small  piezo  actuatcr 
integrated  into  the  knife  holder'*.  Fcxus  and  astigmatian  were  cotitinualy  moni 
tored  (using  the  'heuristic  algorithm'  described  pnrvioiEly'')  on  the  basis  of  acquired 
images  and  automatically  adjusted.  After  each  cut,  a  low  resolution  overview  image 
was  acquired  and  used  to  automatically  detect  cutting  debris  on  the  sirrface.  If  debris 
was  detected,  the  knife  was  passed  over  the  surface  with  40  nm  dearance  in  an 
attempt  to  remove  the  debris.  Consecutive  sboes  were  aligned  oShne  to  sub  pixd 
precision  by  Fourier  shift  based  rnterpclatba  using  cross  correl^on  derived  shift 
vectors.  Note  that  the  sub  volume  inside  the  data  set  that  contains  va£d  data  is  a 
rhomboid. 

Skeletonization.  The  data  set  was  prepared  as  described  previoudy''  for  crowd 
sourced  skeletonization  by  trained  human  annotators,  which  were  specifically 
recruited  fi'om  the  Irxal  student  population  This  is  different  from  some  other 
'citizen  science'  prrjjects  but  encountered  similar  problems,  such  as  the  need  to 
establish  a  mechanism  for  cross  validation.  IIk  data  were  visualized  and  annota 
tions  were  captured  using  the  KNOSSOS  program^  (http://www.knossosttx)l. 
otg).  First,  all  somata  in  the  inner  plexiform  and  ganglion  cell  layers  were  iden 
tified  and  clas.sifled  as  ganglion,  amacrine,  bipolar,  horizontal  and  glia  cells,  using 
the  location  of  each  soma  and  the  types  of  neurites  emerging  from  it.  Then, 
starting  from  the  soma,  each  neuron  was  traced,  by  multiple  tracers  (6, 4  and  4 
for  ganglion  cells,  bipolar  cells  and  amacrine  cells,  respectively).  Tracings  were 
then  consohdated  usit^  RESCOP"  with  the  following  refinements:  all  edges 
within  3  pm  of  the  soma  centre  were  eliminated,  no  edges  were  eliminated 
between  3  and  10  pm,  and,  except  for  somata  in  the  ganglion  cell  layer,  branches 
were  allowed  to  pass  15  pm  only  if  their  multiplicity  (pro  votes)  compared  to  the 
maximum  multiplicity  of  any  bratKh  leaving  the  same  soma  (total  votes)  was 
acceptable  according  to  the  voting  rales".  Type  groiqred  skeletons  were  visually 
scanned  using  Amira  ( VSG,  Merignac  Cedec)  and  KNOSSOS.  For  34  apparently 
aberraiu  branches,  their  originating  branch  points  were  inspected  in  the  raw  data, 
and  removed  if  erroneous  ( 12  cases).  Density  profiles  were  calculated  by  collect 
ing  the  edge  centres  into  50  nm  wide  bins  using  the  length  divided  by  the  total 
vote  count"  for  each  edge  as  the  weight.  Histograms  were  normalized  and  used  to 
calculate  the  quartiles. 

Type  classification.  Cells  were  visually  inspected  using  views  as  shown  in  Fig.  lb. 
The  morphological  criteria  used  were  the  neurite  density  with  depth  in  the  IPL 
and  the  lateral  branching  pattern.  Connectivity  information  was  used  to  sub 
divide  CBC5s  ( see  below).  If  a  cell  could  not  be  grouped  with  at  least  one  other  cell 
it  was  not  assigned  to  a  type  and  instead  added  to  the  'orphan'  category,  even 
when  showing  a  discernible  neurite  morphology  (Supplementary  Data  6).  The 
contact  data  for  the  1 10  orphan  cells  are  not  shown  in  Fig.  4  but  are  iiKluded  in 
Siqrplementary  Data  4  and  5.  We  refer  to  the  types  here  by  their  column/ rowindex 
in  the  type  matrix.  Supplementary  Data  4,  sheet  3,  and  Supplementary  Data  7 


provide  translation  between,  respectively,  the  diflferem  indices  for  individual  cells 
and  between  type  indices,  type  identtfiers,  and  common  type  names. 

The  dassifreation  of  the  cells  proceeded  as  follows.  The  neuri  te  ramification 
pattern  in  the  IPL  particubriy  its  distribution  along  the  light  axis  and  its  overall 
lateral  size,  was  used  first.  We  don't  usually  comment  when  cells  obviously  cluster 
into  a  type  by  those  criteria  (for  example,  types  9,  33  and  51).  Unless  otherwise 
indicated,  percentage  numbers  represent  position  along  the  ligltt  axis.  As  the 
boundaries  of  die  IPL  (0%,  100%),  we  defined  the  points  where  the  total  skeleton 
density  fells  below  15%  of  its  maximiun.  We  use  the  point  where  the  skeleton 
densities  of  ex'!  and  OFT  bipolar  ceUs  cross  over  (463%),  as  the  ON /OFF  bound 
ary.  In  some  cases  (types  58  62,  corresponding  to  CBCl  4,  and  in  one  case  for  the 
CBC5A  versus  CBC5R  distinction)  tve  used,  in  addition,  tilir^  (the  lateral  overiap 
between  neurites  in  the  plane  of  the  retina). 

First,  we  identified  the  ON  and  OFF  SACs  (types  33  and  51).  We  next  con 
sidered  all  remaining  cells  that  had  their  somata  in  the  GCL.  Because  we  were 
initially  not  sure  how  reliably  the  axon  could  be  detected,  we  did  not  use  the 
presence  of  an  axon  as  a  criterion  to  distinguish  gan^on  cells  from  displaced 
amacrine  cells.  In  all  but  one  of  the  cells  classified  as  ganglion  cells  an  axon  was 
found  eventuaOy.  We  begin  with  the  actual  ganglion  cells  (types  1  12),  postpon 
ing  the  discussion  of  displaced  amacrine  cells  (types  27,  43, 51  and  56  57). 

There  are  three  clearly  bistratified  ganglion  cell  types  (2,  8  and  9)  that  exten 
sively  ramify  in  both  ON  and  OFF  byers.  Only  type  2  has  one  of  its  bands 
immediately  adjacent  to  the  INL  whereas  the  lowest  band  of  type  8  is  wdl 
separated  from  the  INL  Additional  discrimination  was  provided  by  bands  at 
50%  and  70%  for  types  2  and  8,  respectively.  Only  one  of  the  type  8  cells  shows 
all  aspects  of  the  deixlritic  tree,  whereas  the  other  two  cells  are  presumably 
missing  parts  of  the  dendrite  iiuide  the  reconstructed  volume  but  share  enough 
features  to  put  them  into  the  same  class.  Type  9  is  the  ON/OFF  13SGC. 

T ype  6  could  be  called  bistratified  bu  t  the  space  between  the  bands  still  contains 
a  lot  of  neurite.  The  two  bands  are  just  inside  the  choline  acetyltransferase 
(ChAT)  bands,  which  is  where  the  SACs  (types  33  and  51)  and  DSGCs  (type  9) 
ramify.  Types  7  and  10  both  have  only  one  band  straddling  the  ON/OFF  border, 
but  7  has  numerous  branches  going  all  the  way  to  the  INL.  Types  7  and  10 
probably  correspond  to  the  two  subtypes  labelled  in  the  TYW3  mouse”. 

Next  we  considered  cells  that  ramify  mostly  in  the  OFF  (types  1 , 3, 4  and  5)  or 
the  ON  layer  (types  1 1  and  12).  Among  those,  only  types  1  and  3  ramify  all  the 
way  up  to  the  I NL  (a  slight  dendritic  resemblance  to  type  27,  a  disp  laced  amacrine 
cell,  can  be  resolved  by  looking  at  the  lateral  (in  plane)  branching  pattern,  which 
is  much  more  tortuous  for  27).  Type  1  has  multiple  branches  emeigii^  directly 
from  the  soma  but  type  3  only  has  a  single  one.  Type  5  has  a  much  denser  in  plane 
branching  pattern  than  type  4.  Type  1 1  ramifies  further  towards  the  GCL  than 
type  5  and  is  broader  than  type  1 0.  Type  12  is  the  only  ganglion  celll  ramifying  in  a 
single  band  adjacent  to  the  GCL. 

Among  the  amacrine  cells  we  started  with  the  narrow  field  types  (13  24). 
Types  18,  20  and  24  all  reach  deep  into  the  ON  layer  and  have  bands  in  both 
the  ON  and  OFF  layers,  which  was  used  to  separate  them  from  23  smd  22,  with  no 
bands  in  the  OFF  layer,  even  though  the  variability  of  the  OFF  band  in  type  20 
made  it  difilcult  to  distinguish  type  20  and  22  cells,  possibly  caus;ing  some  mis 
classification.  Type  18  shows  a  sharp  band  at  about  70%  and  a  broader  band 
touching  the  INL.  Types  13  and  14  were  difiicult  to  distinguish,  but  14  has  a 
clearer  gap  to  the  INL  and  a  less  dense  dendrite.  Types  16  and  17  difler  in  lateral 
size.  Some  overlap  between  16  and  1 5  cannot  be  completely  rule<d  out  but  most 
type  1 5  cells  are  shorter  and  end  mostly  in  a  dense  band.  Types  19  and  21  differ  in 
lateral  size  (21  and  42  may  be  the  same  type). 

Next  we  considered  cells  (types  25, 28, 30  32, 37, 39, 41 , 47, 53  and  57)  in  which 
thebranchingpattem  suggested  wide  fields,  for  example,  because  only  few  of  their 
branches  ended  insicle  the  sample.  Many  of  these  cells  (typies  25, 37 , 39, 4 1, 47  and 
53)  show  a  shaqp  lamination  in  depth.  Only  type  25  ramifies  close  to  the  INL 
Type  30  is  more  strongly  branched  than  28  and  ramifies  broadly  in  depth,  unusual 
for  wide  field  cells.  Type  28,  unlike  type  30,  has  two  branches  leaving  in  opposite 
directions.  Type  3 1  dendri  (es,  uniquely  amor^  the  cells  reconstructed,  go  ofl^  into 
a  narrow  segment.  Type  32  ramifies  in  the  OFF  ChAT  band,  but  branches  dif 
ferently  from  the  OFF  SAC  (type  33).  Type  39  has  only  a  sin^e  primary  branch, 
whereas  type  41,  which  stratifies  at  almost  the  same  depth,  has  seseraL  Note  that 
types  37,  41/39  and  47  subdivide  the  space  between  the  ChAT  brmds  into  three 
equal  sublaminae. 

The  remaining  amacrine  cdls  are  medium  field  cells  (types  26,  27,  29,  33  36, 
38, 40, 42  46,  48  52  and  54  57),  itKiuding  the  unmistakable  SACs  (types  33  and 
51,  see  above).  Types  34  (an  interplexiform  cell),  49  and  52  imiquely  reach  all  the 
way  across  the  IPL  Type  49  has  the  very  distinctive  'waterfall'  anaitomy  and  type 
52  lacks  the  sharp  band  right  outside  the  INL  of  type  34.  Types  315  and  38  were 
distinguished  by  how  far  their  dendrites  reached  towards  the  GCL..  Types  48  and 
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50  differ  in  primary  dendrite  shape  and  in  plane  size  but  may  still  be  the  same 
type:  Type  45  has  more  primary  dendrites  than  type  54. 

To  classify  bipolar  cells  ( types  58  7 1 )  we  first  tried  to  establish  similarity  to  the 
types  described  previously".  The  correspondence  was  mostly  obvious  for  RBCs 
(type  71)  and  ON  CBCs  (types  63  70)  see  the  main  test  for  CBC5  (types  63  65) 
and  X6C  (type  66)  but  rather  difficult  lor  OFF  CBCs  (types  58  62). 

First,  all  OFF  bipolar  cells  were  sorted  using  the  seventy  fifth  percentile  of  the 
cumulative  skdeton  denaty  in  depth  (starting  from  0%)  then,  the  lower  58.2% 
(their  prevalence;  see  Table  1  in  r^  28)  of  cels  were  placed  in  the  CBC3Ay3B/4 
and  the  remainder  into  the  CBCl/2  category.  The  former  was  then  sotted  by 
the  twenty  fifth  percentile.  Because  this  distribution  was  not  clearly  separable 
(consistent  with  the  CBCM  width  being  smaller  and  more  variable  than  drawn 
previously"),  we  began  to  collect  the  CBC4  cells  starting  at  the  highest  twenty 
fifth  percentile  numbers,  adding  cdls  consistent  with  the  mosaic  until  the 
required  prevalence  was  reached.  The  same  procedure,  now  using  the  axonal 
coverage  area,  was  used  to  separate  CBC3A  fi-om  B,  reported  to  be  larger 
CBC3A  (ref.  28),  and  CBCI/2  using  the  spread  in  depth  of  the  axon  (twentieth 
to  eightieth  percentile).  Finally,  all  mosaics  were  inspected  again,  six  ceUs  were 
reassigned,  and  one  cell  (cell  927,  Supplementary  Data  6)  was  moved  to  the 
‘orphan’  group  as  it  did  nut  fit  into  any  of  the  mosaics.  In  the  resulting  grouping, 
types  60  62  show  a  ramification  free  zone  adjacent  to  the  INL  that  is  lacking  in 
types  58  and  59.  Type  59  dendrites,  if  anything,  are  closer  to  the  INL  than  type  58 
dendrites.  Type  62  ramifies  slightly  more  widely  in  depth  than  types  60  and  61. 
Type  61  tends  to  be  smaller  than  type  60. 

Segmentation.  A  feed  forward  convolutional  neural  network^^  was  trained  to 
classify  connectedness  (roughly  a  probability)  between  voxels  sharing  a  face  (the 
Matlab  ccxle  and  the  network  weights  are  in  Supplementary  Data  8).  Several  sub 
volumes  (each  100  X  100  X  100  voxels  in  size)  were  fully  segmented  using  KLEE 
and  served  as  the  initial  training  data,  which  was  gradually  augmented  by  semi 
automatically  segmented  volumes  (proofi'ead  segmentations  generated  with  earlier 
network  versions),  yielding  a  final  training  set  of  12  substantal  volumes  ranging 
from  ( 1 28  voxels)^  to(240  voxels)^  (more  than  800  million  example  image  patches, 
i  nduding  translations  and  rotationsX  The  network  contained  5  hidden  layers  %vith 
10  feature  maps  each  and  was  trained  for  over  53  million  mini  batch  gradient 
update  steps  until  convergence,  oorrrspondir^  to  many  central  processing  unit 
(^U)  months,  in  a  gren^  and  supervised  layer  wise  manner  using  a  modified 
version  of  MAUS",  modified  to  assign  equal  weight  to  each  segment  (S.C.T.  et  oL, 
manuscript  in  preparation).  All  filters  were  7X7X7  voxeh  in  size  and  used  a 
logistic  sigmoid  nonlinearity.  After  classifying  vcxel  connectedness  for  the  whole 
data  set,  segmentation  was  as  folows.  First,  the  voxels  were  clustered  usit^  a 
threshold  of  0.9999.  Ousters  with  £10  voxels  were  used  as  seeds  and  grown  to 
threshold  of  0.999.  Unconsumed  voxels  were  clustered  using  the  same  threshold, 
fofiowed  by  seed  selection  and  growth,  now  to  0.99.  This  procedure  was  repeated 
uang  thresholds  of  0.98, 0.%,  0.94, 0.92, 0.9, 035, 03, 0.7, 03, 03, 0.4  and  02,  and 
resulted  in  the  assignment  of  each  voxels  in  the  data  set  to  a  supervoxel  (on  average 
517  voxels),  which  were  now  merged  using  the  following  criteria:  first,  objects  larger 
than  36  voxels  were  merged  with  each  other  if  the  boundary  classifier  averaged 
across  their  interftice  was  above  a  threshold  that  was  gradually  lowered  from  0.95 
to  0.75  in  linear  steps  of  0.05.  In  the  next  phase,  only  objects  of  unequal  size  were 
allowed  to  merge.  The  'forbidden'  size  intervals  (in  voxels)  and  the  Interface  thresh 
oldsforcachstepwere;2,000  200,0.65:2,000  200,0.6:2,000  200,035:2,000  200, 
035:2,000  400,0.6:2,000  800,03:2,000  1  300,0.^2,000  1,600,0.6:2,000  1300, 
0.6;  5,000  2,000,  0.6;  10300  3,000,  0.6;  20,000  4,000,  03;  25,000  5,000,  0.6; 
30,000  6300,03. 


This  iiKreased  the  average  segment  size  to  2,443  voxels.  Segments  were  then 
assigned  to  that  skeleton  that  had  the  most  nodes  in  the  segment  (only  a  small 
fraction  contained  nodes  from  more  than  one  skeleton).  All  segments  assigned  to 
a  skeleton  comprise  the  volume  reconstruction  of  the  corresponding  celL  The 
volume  fraction  erroneously  assigned  was  estimated  by  summing  the  volume  of 
all  segments  that  contained  multiple  skeletons,  weighted  by  the  fraction  of  mino 
rity  nodes  in  the  segmem  and  divided  by  the  total  volume  of  segments  assigned  to 
any  skeleton. 

Contact  detection.  To  quantify  contacts  between  s^ments,  s^ment  to  segmem 
overlap  nulrices  were  calculated  between  the  original  segmentation  and  versions 
shifted  by  one  voxel,  respectively,  in  the  x,  y  and  z  directions.  The  resulting  three 
coDections  of  overlapping  voxels  were  combined  and  classified  and  grouped  uito 
'contacts'  (Supplementary  Data  8)  using  a  dilation  based  proximity  measure.  The 
contact  areas  were  calculated  uang  the  foUowii^  weights  (nm^  dependii^  on 
according  to  the  combination  of  direction  sets  they  occurred  in:  4123  (x  ory), 
272 J5  (z),  583.363 1  (x  andy),  494.2432  ((x  ory)  and  z),  643. 7644  (x.y  andz).  This 
corrects  for  the  anisotropy  in  voxel  size  and  to  some  extent  for  the  error  intro 
duced  by  the  angle  of  the  contact  surface.  For  surfaces  perpendicular  to  one  of  the 
priiKipal  axes,  the  face  diagonals,  or  the  space  diagonal  this  estimate  is  exact. 
Error  estimation.  To  probe  the  frequency  ofmissed  contacts  (false  negatives)  we 
selected  100  random  locations  on  one  skeleton  (cell  17,  gc36  51,  W3)  and 
searched  for  true  contacts  with  an,  according  to  the  cell  cell  matrix:,  highly  con 
nected  cdl  (cell  344,  ac34  84).  All  16  tme  contacts  found  were  also  found  by  the 
automated  detection  routine.  To  estimate  the  false  positive  rate  we  randomly 
selected  20  of  the  7,21 7  contacts  that  the  same  ganglion  cell  made  with  other  cells 
and  visually  inspected  the  corresponding  locations  in  the  raw  data.  Ln  one  case  no 
actual  contact  existed  (a  piece  of  debris  was  erroneously  attributeii  by  the  seg 
mentation  routine  to  cell  344). 

Sizes  for  synaptic  and  non  synaptic  contacts.  Synaptic  and  non  synaptic  con 
tacts  in  the  conventionally  stained  data  set  (k563)  wae  selected  and  their  contact 
area  determined  in  one  of  two  ways.  (1 )  Starting  from  a  bipolar  cella:<on  terminaL 
asynaptk  ribbon  was  located  (Fig  3d),thetwopostsynapticdyadic{)artner5were 
found  and  their  class  determined,  using  the  presence  or  absence  of  synaptic 
ve^les  (found  in  amacrine  but  not  ganglion  cell  dendrites).  AH  three  dyadic 
partners  and,  in  additioa  a  nearby  non  synaptic  contact  were  manually  recon 
structed  using  the  KLEE  software  tool  (M  ii.  et  aL,  manuscript  in  prqraration)  in 
a  region  including  all  three  contacts.  The  contact  areas  were  determined  as 
ftdlows.  Surface  triangulatiotu  were  generated  for  each  volume  reconstmetion, 
then  for  each  triangle  it  was  determined  whether  there  was  another  object  within 
144  nm  above  it,  next  the  contact  area  with  this  object  was  calculated  as  the  sum 
over  all  hits  in  that  object  weighted  by  the  triar^le  areas.  (2)  All  contacts  with 
bipolar  cells  were  reconstructed  on  several  pieces  of  ganglion  ceil  de  ndrite,  quan 
tified,  and  classified  as  synaptic  when  a  ribbon  was  present  and  :non  synaptic 
otherwise.  Classification,  segmemation  and  contact  detection  trere  performed 
irxiependently  for  each  member  of  a  set  of  overlappii^  cubes  (2K'  voxels  on  a 
side),  one  cube  for  each  interior  data  cube  ( 128  voxels  on  a  side).  Each  of  those 
cubes  overlaps  one  data  cube  completely  and  26  cubes  partially.  To  avoid  double 
counting  we  counted  a  contact  only  when  the  largest  part  of  the  contact  was 
inside  the  completely  overlapped  (central)  data  cube. 
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